Papers with end-to-end answer accuracy
Redefining Retrieval Evaluation in the Era of LLMs (2026.eacl-long)
Copied to clipboard
| Challenge: | Traditional IR metrics assume that humans examine documents sequentially with diminishing attention to lower ranks. |
| Approach: | They propose a utility-based annotation schema that quantifies positive contribution of relevant passages and negative impact of distracting ones. |
| Outcome: | The proposed metric improves correlation with the end-to-end answer accuracy by up to 36% compared to traditional metrics. |
NLKI: A Lightweight Natural Language Knowledge Integration Framework for Improving Small VLMs in Commonsense VQA Tasks (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Small vision-language models lag behind their larger generative counterparts due to lack of knowledge. |
| Approach: | They propose a framework that integrates commonsense knowledge into small vision-language models . the framework retrieves natural language facts and prompts an LLM to craft natural language explanations . |
| Outcome: | The proposed framework retrieves natural language facts and prompts an LLM to craft natural language explanations. |
Progressive Multimodal Search and Reasoning for Knowledge-Intensive Visual Question Answering (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to knowledge-intensive visual question answering lack mechanisms to revise misdirected reasoning. |
| Approach: | They propose a framework that progressively constructs a structured reasoning trajectory . they use dual-scope queries to retrieve diverse knowledge from heterogeneous knowledge bases . |
| Outcome: | The proposed framework improves retrieval recall and end-to-end answer accuracy. |